Animation of talking agents
نویسنده
چکیده
It is envisioned that autonomous software agents that can communicate using speech and gesture will soon be on everybody’s computer screen. This paper describes an architecture that can be used to design and animate characters capable of lip-synchronised synthetic speech as well as body gestures, for use in for example spoken dialogue systems. A general scheme for computationally efficient parametric deformation of facial surfaces is presented, as well as techniques for generation of bimodal speech, facial expressions and body gestures in a spoken dialogue system. Results indicating that an animated cartoon-like character can be a significant contribution to speech intelligibility, are also reported.
منابع مشابه
Integration of talking heads and text-to-speech synthesizers for visual TTS
The integration of text-to-speech (TTS) synthesis and animation of synthetic faces allows new applications like visual human computer interfaces using agents or avatars. The TTS informs the talking head when phonemes are spoken. The appropriate mouth shapes are animated and rendered while the TTS produces the sound. We call this integrated system of TTS and animation a Visual TTS (VTTS). This p...
متن کاملAutomatically Generating Eye Motion in Virtual Agents
Eye Motion has a fundamental role in verbal and non-verbal communication among people. It can express emotions and regulate the flow of conversation. For this reason, it is very important that these movements can be realistic in Computer Animation’s applications, such as virtual humans in general and game/movies characters. This paper presents a model for producing eye movements in synthetic ag...
متن کاملDeveloping and Evaluating of Non- Realistic Three-Dimensional (3d-Nr) And Two-Dimensional (2d) Talking-Head Animation Courseware
The talking‐head animation is an instructional animation capable of improving the communication skills through enhancing the pronunciation skills; whereby a word is pronounced correctly and accurately. This had been proven by several researches, which indicate that learning with interactive animation is much more advantageous than conventional learning. Hence, the...
متن کاملReal-time streaming for the animation of talking faces in multiuser environments
In order to enable face animation on the Internet using high quality synthetic speech, the Text-to-Speech (TTS) servers need to be implemented on network-based servers and shared by many users. The output of a TTS server is used to animate talking heads as defined in MPEG-4. The TTS server creates two sets of data: audio data and Phonemes with optional Facial Animation Parameters (FAP) like smi...
متن کاملTalking Head: Synthetic Video Facial Animation in MPEG-4
We present a system for facial modeling and animation that aims at the generation of photo-realistic models and performance driven animation. It is practical implementation of MPEG-4 compliant Synthetic Video Facial Animation pipeline (Simple and Calibration Profiles with some modifications), which includes: facial features recognition & tracking on real video sequence; obtaining, encoding, net...
متن کاملLanguage-driven nonverbal communication in a bilingual conversational agent - Computer Animation and Social Agents, 2003. 16th International Conference on
This paper describes an animated conversational agent called Kare1 which integrates a talking head interface with a linguistically motivated human-machine dialogue system. The agent has a range of nonverbal behaviors, which involve a mixture of machine vision, computer animation and natural language processing techniques. The system’s architecture couples the agent’s nonverbal communicative pro...
متن کامل